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s v Effect i ve writ ing assessment involve s judg i ng how 
a wr i ter i s encouraged by the clas sroom's soc ial context to pull 
together ideas and to bring experience to bear on abstractions. Four 
: main points can be made to justify this view. First, assessment by 
standardised test determines a teach-and-test model of instruction, 
I But m curriculum that emphasizes writing processes is richer and can 
jV;be tested using direct assessment by writing sample, such as the ^ # 
Stanford Writing Assessment Program, Second, teach-and-test models of 
; writing instruction conflict with good writing theory, A good model 
^ emphasizes revision, talking , reading, and 

^ learning and can be tested through essay ques t i on s that per ta in to 
these experiences . Third, assessment by standardized testis a deeply 
rooted problem allied with the teach^and^test research tradition ; 
both proceed by means of oversimplified logic requiring written 
:% P r 9 duc * s ^ t o ^ play an o ve r s i mpl i f i ed r o 1 e . However , new research 
teaches a more complicated logic about product. Fourth, this new 
logic shows that standardized test ing needs to be supplemented by 
7; assessment that is functional and that recognizes learning as 



in 



students writing. (Hawaii 'm educational system is highlighted. ) A 
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WRITING ASSESSMENT RE-EXAMINED 

Some years ago comedian Tom Lehrer, in a little ditty, 
parodied the New Math. Strumming him guitar in a Ban Francisco 
night club, he ran through a compl i cated expl anation as he 
subtracted one simple number from another- The answer r as it 
turned out, was wrong. "Oh, wel l , he said, "the answer's not 
important, I ^ot there the right way. " The audience 
hooted* /'••• ! -^y: : •-^•/ , \ ; - • " 1 ^ :} f^'-'-^-" Kr -' 1 

In the teaching of English those with professional training 
are wet 1 aware that "Process" is crucial in the teaching of 
writing. But Writing Process, like the New Math, wi 11 come in 
for deserved ridicule if no one says what in the end should be 
assessed. The argument here is that assessment can be 
rationally carried out. The argument is also that assessors 
should have their eyes open to what is real ly going on in the 
process of writing. What * s going on is practice in 
probl em-sol vi ng and analysis ; what * s created i s an i nt er ac t i ve 
social cpntext that, from a Vygotski an perspective, is crucial 
for both language to grow and thi nki ng to f 1 uor i ^h. If 



assessment is doing its job, it; needs to judge how well the 
writer im encouraged by the social content of the classroom to 
pul 1 things together that otherwise exist for the writer in 
bits and pieces, and how well the writer U engaged in bringing 
experience to bear on abstractions. Writing should be assessed 
for: how well it succeeds in doing all of this- i 

But this is getting ahead of the story- To arrive at this 
conclusions, four arguments about writing assessment need to be 
mades -^SK ' ; / ••• ' V : ^ $[ W*W 1l ^€'fW* ' " ] , 

1 - Assessment by standardized test determines curricul urn. It 
conveys to teachers a teach'-and^test model of instruction. 

2- Such a model of instructi on conf 1 i cts with good wr i t i ng 
theory, a problem that may be alleviated by changing the test 
somewhat- _ , ' ... . If* '' % :§? Z-^T'^^a 

3- Sti 1 1 the problem is deep-^rooted . Assessment by ^ 
standardized test is all i ed wi th a teach— and^t est research v '■ . 
tradition^ both assessment and thi i brand of research proceed 
by means of an oversimplified logic that requires products to 
play an oyersimpiif led role. New research teaches a new and 
more compl i cated 1 ogi c about product . y*- : :.:' r % : ^%\. 
4. This newer logic shows that standardized testing needs to be 
supplemented by assessment that is functional - 

Point Is Assessment procedure's are? in effect? a ::-y^" r 
model ; of instruction* ..-.../ y k.^t. , 

On this point I have a story to t el 1 about the assessment 
of writing skills in Hawaii that is no doubt closely paralleled 
by 5 stor i es i n other districts and countries. 

The state of Hawaii has i central administration for state 



education, including two people whose whoJ& job is to do 
nothing but test. These people— and interviewed one of these 

the director, a imart and sensitive man— have been looking 
for a new and better way t© assess writing. They think that 
multiple-choice testing is invalid, and direct assessment by 
writing sample a better way. In order to assess by writing 
sample, they have adopted the Stanf ord Wri ting Assessment 
program, which sets out four different writing tasks* One of 
these tasks calls for description, one for narration, one for 
reasoning, and one for enplaining. Children are tested in 
Grades 3, 6, B and 10; last year warn the first year for the 
test, and it warn given only to third gradermp but older 
children will be tested as the years go by. The testing 
director * because he wishes to take as little time as possible 
out of the school day, asked last year for one writing sample 
only, the describing sample. The sample was scored both f" 
hoi isti call y and f mr various triits, and the numerical scores 
were sent back to the school * For the sake of varying, the 
task, this yearns third graders will do the narrating, not the 
describing task that last year's children did. 

Test scores in Hawaii are big news. The reading and math 
scores are published in Honolulu's paper. For each school the 
p aper lists the per cent below the range of the national 
average, the percent within this range, and the percent above, v -r % 
Statewide, Hawaii is a little above the national average in ; 
math, somewhat below in reading. Real estate brokers want the 



Diamond Head. Reading comprehension and math are therefore 
extremely important values in the community, Now that writing 
too can be assessed in numerical terms, averaged , and compared 
with the scores of other districts in the islands, writing 
scores too wi 1 1 be newsworthy. 

As you know, standardized testing has led many teachers to 
teach by ditto Bhmmt mUmrmimmm instead of books and discussion. 



What, one wonders, will it do to writing? In particular, I 
asked the director of testing in Hawai i how he thought the 
Stanford Assessment Test of Writing might affect classroom 
teaching. , I knew the issue concerned him. Yes, it was a : 
problem, he said, the whole question of teachers teaching to 
the test - Si nee there were only two people to carry out 
standardised testing for the ent ire state , the t i e-i n with 
i nstrueti on had to be handled by the instructional divi si on - 
People in the instructional division held meetings with the! 
supervisors of language arts for the various islands, and on 
the island pf Oahu, for the various di str lets"* the Leeward 
di strict, the Windward district, the Honolulu di strict, and so 
on. / These super vi sors, i n turn , en pi ai ned to teacher s flaw the 
test related to instruction, .,• ; ,, ■ - - . fprfl?5"Sr|r, 

Let me reassure you. Even in a s tern 1 i ke this one, the 
news about the test travels quickly to the schools. The word 
gets out. At a recent one^day conference on assessment, I ^ 
asked a third grade teacher from the blue collar area of Pearl 
City— some 20 mi I mm from the center of Hanoi ulu — how she 
thought the new assessment i n wri ti ng was working . "Better 




eBcr i & 1 n_Q $ *° w»vdidn 't know what to vpr ©p«ff^; ; ^8li#;' *#iS:iJi^t^n/:-to - v 

•••••.•^;-^-,-What;' wi 11 happen in this classroom tm r ^mmmont-n^- 
explaining arid describing? Im^only narr^tfSf impt ^artf ^for 
third graders to learn? Obviously tht tttiifi| di^tetil' did not 
think so, and did not intend to communic^^ ^ ih:|,;fe tit the 
teacher f knowing how important it is f m£ -gito^Mkren to do 

wel 1 on the test—the Fear 1 Ci ty nei ghbeirftiQod ha% pri de just as 
Kahala has— -seems quite ready to forsikt ottier *orms of 
writing- Things could be worse — narrative is not a bad choice 
.if one must choose a single -form—but richer is a curriculum 
that includes explaining, describing, and reasoning, 

I do not envy the direct or-of -test i ng his j ob , He was 
probably never told by anyone that he p more than anyone else in 
the educational establ i shment 9 was going to set curriculum^ and 
he makes no clai ms to knowing what e 1 assroom enerci set make for 
the best instruction. Yet the test itself and the way it sits 
in judgment on teaching have made him into an authority figure* 
Test scores are easy to understand; they are in education the 
Gr eat Communicators, and in the end they say what to teach and ' 
what to leave out of the daily schedule. We know that for 
years when writing was hardly evaluated at al 1 y the t i me spent 
j on i t i n f the ml assroom deel i ned to a horr i f yi ng few mi nutes 

each day. Now that writing is back in the curri cul um t teachers 

will no doubt decide Nhat to teach by looking at what is 

' s '. : V"".."... ' ' , ' , ^ 

assessed down the line. 



Point 2. Temch^snd'-test model & of instruct i on con fl let with 

In Hawaii and ml sewhere th©re i © m serious mi smatch between 
A two instructional model s™the model communicated by the test 
and the model that ought to be in place in day-to-day classroom 
teaching* To improve the Hawaii test, one simple thing can be 
donei draw -from a hat the kind of task that will be required 
and not announce it in advance, The message to teachers then 
changes; not one but four kinds Of thinking and writing are 
important 5 not one but four kinds should be done by the 
children in the classroom. 

But still the greater problem will remain: the difficulty 
of making the instrument of assessment match up with a good 
; model of instruction* A good model of writing instruction"! 
"process^ model —views writing not as a ski 11 exercised in 
i solati on but an activity whose purpose is made plain by other] 
activities that come before and after it, Good teachers have W 
always somehow known this,' but now a rich body of literature 
argues this as wel 1 The bibliography 1 ists samples from the 

; Li,; 11 terature that can be p laced i n four cat eg or i es i < 1 ) the 

wri ting devel opm^nt of young chi 1 dr en 3-6, <2> the development 

% of children 7-11, (3) the development of secondary and college 

students, and (4) articles on overall development* Al 1 of 

these argue; that writing instruction should rest on four 

pi 1 1 ar s*— revi si on , tal k , reading, and learning. 

1 - Revision* Learning to wri te requi res t i me f or students 
to re-write and incentive to re -write (for example, Perl , 



■ ■; 3. Reading. Wri ti ng ihould sometimes serve to make sense 
of reading, to bring prior knowledge to bear on reading,: to 
motivate the read <f or eHample, Cal kins, 1983) . 

Learning- Writing should make writers curious about 
their- f pp.i;c .^^citi nQ^£il*:M*y: of making story and argument out 
°*oth®rwi#e fragmented bits of information* From writing come 
two kinds of resul ts-r 1 earni ng to write and just pi ain 
learning—which should not be separated < Br i 1 1 on P e t a 1 , 1 975 > . 

Now let us look at writing tasks for standardized testing* 
Do these all ow time for revision? Al most never » Do they allow 
students time to talk to each other after writing a first 
draft? No- Do they ask for writing as a reaction to reading? 
Do they ask the writer to bring personal experience to bear on 
reading? Almost never. Are the samples evaluated for what the 
wri ter learned in doing them? No. 

I am a practical person and I see that the standardised 
testing of wri ting ii mandatory in the S. Qtherwi se, wri ting 
1 oses out to read i ng and mat hi nth© compet it ion f or ti me i n 
the daily schedule, and wri ti ng remains invi si ble in the public 
eye . Vet in no way can the writing of a standardized test 
sample replicate the writing activities that go cm in good 
classrooms* By its very nature as a test item, the. sample is 
finished within a single sitting. It is not practical to 
combine reading with writing i n the test because the pressure 
of the test allows too 1 i ttl e time - to react intel 1 i gent 1 y,, and 
the writing that resul ts looks undigested and incoherent. To 
have the students read ahead of time— a day or two ^ % 

ahead— creates a f 1 urry of teaching to the test. As for talk 4 
and small -group response, it is impractical to suppose that 
pupils can write a draft, consul t their response groups, mul 1 .'• 
over the response and then write their test essay. , 

•v;^;>^.;- r.. r'> ^;f^>i'V v? " >^" 4 ■ »v ^.-fyvr- ■ ■ ■ :; ,^v.' : ;, ,; : : ' ■ ■•;?::-;'- iv ; ! .; : : - 

Instructions for admini storing a test of this ki nd woul d be 



impossibly complicated* So the problem it how to solicit a 

wr i ti ng sample from students that will typify the writing they 

^ do under admi ttedly different ci rcumstances i n the eUisroomp 
how to ask for a sample in a way that wi 11 net do violence to 

the four—pi 1 ! ar teachi ng approach. \; 

I, have a modest proposal ^^no irony intended, f or this is 
truly modest^^which might work well in a teaching (community 
where members agree on the value of integrated language arts. 
In a school of this kind children will have memories aplenty to 
write about if they are asked to recall a time during the year 
when they worked on a pi act of wr i t i ng that was i mportant to 

: them- Agai n there wou) d be four quest ions, one of which would 
be drawn from a hat. One of the four, phrased in a way to suit 
- the age level , would ask the students to explain or describe 
the experience of doing this writing. The experience would 
include any reading, tal king, or learning that — in the mind of 

. > the V student —was rel ated to - the wr i t i ng JP, . : . ' ; - •• 

Would this work? * *\ <V : .-,,»< * & •< , *' 

Teachers would need to agree in advance that this type of 
question n$as a good ones in fact, reaching teacher concensus by 
tal king together would bt part of the benef i t. There would be 
further benefits as well. The test question, even if only one 
of the four, would be tied to and supportive of the values of 
the teaching community* It would make clear reference to 
instructional policy. Yes, it would mi h up writing skill with C 
prior knowledge, but knowledge should! be considered an 
essential part of the product, not a confounding variable. 

And, yes, a new child moving in from another district might 

-m^m . - ; ^.r *^v . . '. 'V':;'^^ ■ ' ' , , . -. , . •■ ''-V4^' : - 

hivt ,to be given a different question. And 4 yes. the test 



results caul d hardly be compared to national norms, But tl hit 
kind of wr i t i ng ; quest ion would do somethi ng i roper tint i n V V 
t tacKilnft cbmifiUni ty that shows signs of wanting to adopt 4 
common broad policy for the teaching of writing. It would 
acknowledge the fact that assessment is more than in instre ument 

•;,,©f ©valuation? it is also an instrument of communkition #»xnd 

- mutual -support v _ ;^ : '"' A> 

I remain tentative in making this suggestion because Z I 
>uspect . that in most places teachers would find i t hard ta * gai n 
concensus among themselves, especially if they wmn to bud k the 
trend toward greater use of standardized testing Jnd, nat i Oiwial 
norms. It Is r clear that in their rather uncomf or. table 
relationship with assessment , teachers f eel they - -should QP 
along in the direction that assessment sets. t 

Point 3. The problem is deep-rooted* Qssessmmt by - 
standardized test is ml 1 Jed with a. teach-and-test research 
tradition § both assessment and this brand of research proc^^ed 
j by '"means of an oyer simp! i f i ed log i c that re qui res ; product^ : : to 
j play an oversimpli fied role* i New research teaches a r>e*t Sf^wjd 
more compl icated logic about product # "'TT: \ : ' : ' : "' 0? ":^ v • ' ~' 

This is the bigger picture, the bigger probltfli! in thw 
relationship between writing instruction and writing 
assessment, instruction finds it hard to speak up- I now k^ant 
to argue that; this larger picture should change. 

- How instruction came to be the domi nated partner is a 
question that Frank Smith answers in this ways both 
instruction and assessment took their lead from learning l \- 
theory. Learn i ng theory came f rom departments of r psychol r^Cm y , 



10 



which were themselves abominated by experimental design and by 
the wh©l e. bihavi or i «--tradi ti on of rtitarch. Thim tradi tion 
emade asmeisment by nUffl&eri cal method the underpinning for 
research in learning* €^and this is how numbers got to be king. 

i !^ is better suited to learning 

by rats than learning ttey humans* 

Tp -_©ome: intent I ^iiagrit. Quantitative methods are not 
the calprit; we jU5t Maave to be sure that what we count is what 
we want to count. Bufc^p like Smith, I point my finger at the 

experimental tradi tiQr^ -and many others have done so am well , 

From the 1920s through the 1960s we were al 1 led to believe ; 
that written products ^ere the result of an independent 

V<:- •; .;. .: ,:} : Y ./"''' ' . .-. C- - : ■ :'""-.!.../.*,'..■.•.'••■• ' ' r ••>■..■. ,.. r . . ■ :V;*:v,,ffi 

. .7.-. •; . •>•,• " ' '" v: V; > •; • "' . %'■ ■/< • •"<. \ ^,14- ■: ?■* "'■>,'"■ \^Q.f<'f'-'- 'I' '' >■ ' '"i- "' : < v ^:. j ■ 2 ■'■ '■' 

variable called "t^chUingp" and that given the right teaching? 
you should get the, ri ^hrtnt product - A single cause, single 
effect * , Not only was ^his an over si mpl if ied approach to 
teachingi it was alisO ^mn over si mpl if ied approach to product 
itself, as though th£ taroduct were either right or so many 
degrees along the path toward bei ng right . Pi cki ng up a piece 
of writing, teacherm hteve been trained to say, "This one is 
good on organ i a at i Oh f geood in grammar, poor in style, poor in 
ideas, oyeral 1 f ai r * ,f ; Th is one i s so many degrees toward being 
something a reader w£nt±s to read and finds acceptable to the 
eyes. • ^ • *: 

But what if on# fcur— ned this logic of assessment around and 
loQk#d #t products in t „ — erms of their usefulness to the writer*? 
Imagine yoursel f at t site of an archaeological di g , 
Anthropologists stand 4 n«og at this site are interested i n 



products. But they sayv more than f''this^ 




They also may » M Look at this bowl and its peculiir shape j th^m^ T 
people must have had a special use for it. And in this oth^r 
cbowl^^ ear 1 y att empt to use g 1 ai i n g ? how Z % % 

different from -later bowls of the same culture. " 

The difference in theme remarks is the difference betNeer\ 
two kinds of evaluation P one aesthetic and the other K 
functional - As for writing, the aesthetic evaluator nikts " Hew 
effective is this piece of writing in terms of reader "VXy 
response?" The functional evaluator asks, "How did this A f ? 

product serve the writer? what was i t used for? what wats t|i%" < 
writer trying to do?" ; v..y:--- ~;y^ 

To be in 1 i ne wi th writing as an instrument of 1 earn i no y - I 
assessment has to be, in part, functional. It has not beon 
f unctional in the past. - .^^.■^^ ^r,:^.^ s "['^ ■ 

Enter at thi s point Research* Not qui te on a white hor^^ 

,- ; '--v,-. ■l.i-:/ " . - • •' ? - ; '">• ... .'• ...... (> . J ., * ~y • ■■■ . •. " ^-.^'.V ■ =' s ' •• * Tc * • "•• • ■■■ ,V ■•■ ■■ t^' ' ' ■ j- 

but certai nl y different from the old experimental tradi t i on ^nd ^ 
its heavy emphasis on large samples and large numbers. Goin^j M 
down the list of references at the end of this paper, pna f i frid0 
that researcher after resear 

individual and is looking at writing as it leads in and out 
talking, . revi sing, and thi nkl ng. ^ ^: 

"Why do little kids use listing so much?" ask people 1 suth 
as Clay and Newkirk. ■ -:.7: ,*'• 

"What do students do when they revise?" asks Perl* M Wjh#ifc 
causes writer's biock'? ,, asks Rose. 

"How does writing lead into reading?" ask Harste* 



much as an anthropologist examines « bowl: what is the user 
doing with this and what does the user get out of it? 

Is it any wonder that a research model of this kind ham 
become a teaching model*? Srivii hii commented that what began 
for him am simple classroom research became a teachi ng model 9 
quite without his intending it. Is it any wonder that good 
writing teachers naturally turn to this kind of classroom 
research themselves? Process teaching <or 4-pi 1 lar teaching) 
And descriptive research support each other, Now assessment 
needs to come on board as well, 

Schools have had writing assessment for years* and now 
school districts are about to launch into industrial strength 
standardised testing. Has any of this, or will any of this f 
show which writers usa writing to explore new concepts? Does 
any of this assessment say whether or not the writer used 
writing to respond to talk? This is assessment* s job, but 
assessment is not doing it. 

Numbers are important, but numbers are not king,, A new 
tradition of research should now tell assessment what it needs 
to do; what it needs to do is say whether or not a young writer 
is using writing for purposes of pulling things together and 
making sense out of them. 

Point 4. The standardized testing of writing should be 
supplemented by assessment that is functional * 

1 now have another proposal „ this one less modest. What I 
propose it to show assessment how to find evidence of 
constructive acts In ysrt t ten product s. The 1 i st below names 
constructive acts that young writers have been seen to carry ! 



out. 



CONSTRUCTIVE AND INTEGRATIVE ACTS 
it Is the writer trying out a new form*? 

2. Is the writer referring to reading, or perhaps imitating 
reading? 

3. Im the writer making jokes, playing with words, or working 
far visual effect? 

4. Im the writer attempting to integrate thoughts brought up 
in a recent discussion? 

5# Does the writer attempt to include elaborative detail 
within a narrative that really has function within the 
narrative? 

hm If the topic is new to the writer, does the writer attempt 
to relate it to prior knowledge? 

7* Does the writer attempt to use conceptual language recently 
acquired? 

8. Does the writer attempt, either consciously or 
unconsciously, to make writing conform with a principle of 
writing style? 



The point for assessment is that learning is valuable, and 
where the writer attempts to carry out one or more of the acts 
above, the assessor should give points. I am still a practical 
person, still concerned with devising systems of evaluation 
that wi 11 :j work* Assessors are smart people; they can be taught 
to read products with an eye to the 1 earning f unctions I have 
mentioned here. Products are usually qui te transparent in this 



regardi teachers in particular can spot the place in the tent 
where the writer i m tryi ng something new* 

Functional assessment could be carried out, I would 
suggest, on a school -wide basis. A checklist style of form 
coul d be f i 1 ed away in the indi vi dual chi Id* m test f ol der p i f 
there were such a thing, in the school 's main officep the form 
could show what kind of new learning the writer has used 
writing for. This record could serve as part of the basis for 
the itudint'm report card. Most important, it would send a 
message to each language arts teacher from the teaching 
1 eader shx p : 

L&mming is important 9 And in this school ? NJ*itir?g 
smrves a Immrning purpose . 

Many in the field of Engl ish teachi ng are interested in 
so-called "process" approaches, but none can afford to leave 
product out. Assessors need to be taught how to read products 
with an eye toward the writer's learning purpose. Knowledge in 
transition has a way of sounding rough , undigested P perhaps 
"copied" and out of tune with the writer's voice. Teachers need 
to teach assessors that this is the case. Doing so would help 
to set the relationship right between instruction and 
assessment - 
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